DOCOHEHT BBSOHB 



BD 05« 317 



7T 010 848 



AUTHOR 

TITLE 

INSTITUTION 

SPONS AGENCY 
REPORT NO 
PUB DATE 
NOTE 



Hayo, Clyde C. 

Three Studies of Job Inventory Procedures: Selecting 
Duty Categories, Interviewing, and Sampling. 

Lifson, Wilson, Ferguson, and Winich, Inc., Dallas, 
Tex. 

Air Force Personnel Research Div., Lackland AFB, Tex. 

AFHRL-TR-69-32 

Nov 69 

16p. 



EDRS PRICE EDRS Price HF-$0.65 HC-83.29 

DESCRIPTORS *Arned Forces, Bibliographies, *Interviews, *Job 

Analysis, ^Sampling, Tables (Data) 

IDENTIFIERS Technical Advisers, ^United States Air Force 



ABSTRACT 

Three United States Air Force job inventory 
procedures were studied in depth, oitegorizing task statements by 
duties, interviewing technical advisers for job information, and 
detecting bias in survey samples. Variations in the usual grouping of 
supervisory tasks were found to be occasionally necessary. Depending 
upon the career ladder surveyed, nonsupervisory tasks are best 
organized by work section, function, or equipment format. Criteria 
ara suggested for determining the point at which interviews become 
more productive than publication research. Interviewing is more 
effective when advisers are chosen according to experience, rank, 
kind of organization to which assigned, and job type. An analysis of 
trends in 10 survey samples shoved few unexplainable 
underrepresentations. (Author) 



O 

ERIC 



£0054317 



AFHRLTR -69-32 



g 

Shi. 



THREE STUDIES OF JOB INVENTORY PhOCEOURES: 
SELECTING DUTY CATEGORIES, INTERVIEWING, AND SAMPLING 



By 

CiydtC.MiVO 

LHtoii. WHIOII, r«fftytoii, and Wliitek, inc. 




PERSONNEL RESEARCH DIVISION 
Lackland Air Foroa Bata, T«xai 



O 

ERIC 



AIR FORCE SYSTEMS COMMAND 

BROOKS AIR FORCE BASE TEXAS 

1 



NOTICE 



When US Government drawing!, tpecificationt, or other data are used 
for any purpose other than a definitely related Government 
procurement operation, the Government thereby incurs no 
responsibility nor any obligation whatsoever, and the fact that the 
Government may have formulated, furnished, or in any way supplied 
the said drawings, specifications, or other data is not to be regarded by 
implication or otherwise, as in any manner licensing the holder or any 
other person or corpoiration, or conveying any ri^ts or permission to 
manufacture, use, or sell any patented invention that may in any way 
be related thereto. 



Composition: Hope De La Cruz 
Mary L. Alvarado 






o 




2 



E0054317 



AFHRL-TR-69-32 



1909 



THREE STUDIESiOF JOB INVENTORY PROCEDURES: 
SELECTING DUTY CATEGORIES, INTERVIEWING, AND SAMPLING 



U.l. DEPARTMENT OE HEALTH. EDUCATION 
A WELFARE 
OFFICE OF EDUCATION 

THIS DOCUMENT HAS IEET^ REPRODUCED 
EXACTLY AS RECEIVED FROM THE PERSON OR 
ORGANIZATION ORIGINATING IT. POINTS OF 
VIEW OR OPINIONS STATED DO NOT NECES> 
SARILY REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY. 



By 

ClydiC.Mayo 

WlliMI, f IfMWIi, Mitf WlNllk, INN. 



nils documeat hu been approved for pubttc releaee and nle ; 
ito difivibutkm 9 nnlMted. 



HMONNtl. HKSKAHCH DIVISION 
AIN PONCe HUMAN NtSOUNCU LANONATONV 
AIN PONCB SVSTCMS COMMAND 
LaefclanS Air Pome BatA Texas 




3 



- -A 






FOREWORD 



Th^s fcport, prepared by Lifson, Wilton, Ferguson, and Winick, Inc. under Contract 
F41609-68’C'0016, it one of three pubUthed at a product of this contract. The other 
reports in the series are AFHRL*TR-69-27, Conttmetion and Admini$tration of Ten Air 
Force Job irwentories, and AFHRLrTR-69-3S, A Method for Determining Job Types for 
Low Aptitude Airmen. Qyde C. Miyo was the Prqect Director. Dr. Joseph E. North 
monitored the contract for the Persoimel Research Division, tinted materials used in the 
study were reproduced Penonnel Research Division, Air Force Human Resources 
Laboratory. 

This study was performed under Project 7734, Developiitent of Methods for 
Describing, Evaluating, and Structuring Air Force Occupations; Task 773401, 
Development of Methods for Collecting, Analyzing, and Reporting Information 
Describing Air Force Specialties. 
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ABSTRACT 



Three United States Air Force job inventory procedures were studied in depth: 
categorizing tesk statements by duties, interviewing technical advisers for job 
information, and detecting bias in survey samfries. Variations in the usual grouping of 
sup^^rvisory tasks were found to be occasionally necessary. Depending upon the career 
ladder surveyed, non>supervisory tasks are best organized by work section, by function, 
or by equipment format. Criteria are suggested for determining the point at which 
interviews become ntore productive than publicatioiu research. Interviewing is more 
effective udien advisers are chosen according to experience, rank, kind of organization to 
whidi assigned, and job type. An analysis of trends in ten survey samples showed few 
unexplainable underrepresentations. 



SUMMARY 



layo, C.C. Three studies of job inventory procedures: selecting duty categories, interviewing, artd sampling. 

AFHRL-TR-69-32. Lackland AFB, Tex.: Personnel Research Division, Air Force Human Resources 

Laboratory, November 1969. 

foUem 

In the research program in occupational structures in the Air Force, effort is continually directed 
award improvement of procedures and development of new methodological approaches to job analysis, 
huing the construction and administration of experimental inventories for several Air Force career ladders, 
number of observations were nuide and experiences were gained which seemed to.have practical value and 
eneral applicability as guidelines for development and administration of job survey instruments. 

ipproach 

Three aspects of job survey methodology were examined. Alternative variations in categorization of 
isks were evaluated; principles were enunciated for timing interviews in relation to publications review, 
nd some guidelines were established for sdection and appraisal of interviewees; and, finally, a statistical 
Kthod for measuring sample bias was applied to demonstrate the representativeness of the survey samples, 
n the sections on categorizing tasks and interviewing, examples from the experimental inventories were 
sed to illustrate applications of the principles. In the section on sample bias, data on the composition of 
he survey samples were presented and evaluated to indicate the degree to which the sanqries were 
spresentive of the career ladder populations. 

tesults and Conclusions 

A number of conclusions may be drawn from study of the three aspects of job inventory construction 
nd administration. 

1. Duty Categories. Variations in the usual four-duty fomut foir supervisory tasks are occasionally 
ecessary. Three rather stable organizations for non-supervisory tasks ate the work section, function, and 
quipment formats. In the work section format, tasks are arranged in groups parallel to the v;ork sections of 
rganizational charts. Tasks are grouped under typical functions charged to a career ladder in the function 
ortnat. Tasks are arranged under equipment categories in the equipment format. 

2. Interviewing. The value of interviews to derive job information can be enhanced by consideration 
•f several factors. Pint, the point at which interviewing becomes more productive than publications 
esearch should be recognized. Second, interviewing is more productive when advisers are chosen on the 
'asis of experience, present job type, rank, and size and type of installation of assignment. A variety of 
timuli, induding questioning the form or content of task statements, can be used to elicit recall. A 
naximum of time can be spent with better interviewees and a minimum with poorer ones. Individual 
nterviews can be nwie effectively used during the early phases; group interviews are valuable later. 

3. Sampling. Perfect oomspondence between sample and population strata is not necessary because 
ample sizes are typically quite large. Analyses of trends of over- and underrepresentation of various sample 
haracteristks can be used to ensure that survey samples are representative, however. An analysis of trends 
1 ten inventory samples showed few unexplainable underrepresentations. 

This summary was prepared by J.E. Morsh, Occupational Research Branch, Personnel Research 
Nvision, Air Force Human Resources Laboratory. 
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THREE STUDIES OF JOB INVENTORY PROCEDURES: 
SELECTING DUTY CATEGORIES, INTERVIEWING, AND SAMPLING 



I. INTRODUCTION 

The research program in occupational struc- 
tures in the Air Force incorporates a comprehen- 
sive method of job analysis with data processing 
by electronic computer. Th'' method is concise in 
that its stages are well deflr. .d; it is broad in that it 
is susceptible to continuing study and improve- 
ment. Basically, it consists of compiling lists of 
tasks from source materials, interviewing technical 
advisers for modification of the lists, mailing the 
resulting preliminary job inventory to advisers in 
the field for further modifications, compiling the 
final version, selecting a sample for administration, 
administering the final version to incumbents, and 
recording and analyzing the results (Morsh & 
Archer, 1967). 

The studies presented were directed toward im-. 
provement in job analysis procedures. From obser- 
vations and experience gained during the construc- 
tion and administration of experimental job inven- 
tories, three aspects of job survey methodology 
were examined. Alternative variations in categor- 
ization of tasks were evaluated; principles were 
enunciated for timing interviews in relation to 
publications review, and some guidelines were 
established for selection and appraisal of inter: 
viewees; and finally, a statistical method for meas- 
uring sample bias was shown to be feasible. In the 
sections on categorizing tasks and interviewing, 
examples from the experimental inventories are 
used to illustrate applications of the principles. In 
the section on sample bias, data on the com- 
position of the survey samples are presented to 
demonstrate the degree to w^ich samples are rep- 
resentative of career ladder populations. 



II. CATEGORIZING TASKS BY DUTIES 

The task statements in a job inventory are ar- 
ranged in some logical fashion to facilitate admin- 
istration. When the subject perceives the logic of 
the arrangement of task statements, he is able to 
concentrate attention on those duties which best 
describe his job. A duty, which may include any 
number of tasks, is considered to be a large por- 
tion of the work performed by an individual 
(Morsh, Madden, & Christal, 1961). The particular 
arrangement of task statements by duty categories 
is individually sdected for each job inventory. The 
broad headings in job training standards and organ- 



izational charts depicting work section subdivi- 
sions cap be used as guidelines for defining duty 
categories. 

Supeivisoiy Duties 

Usually, supervisory tasks are placed under one 
o\ four duty categories: (<i) Planning and Organ- 
izing, (b) Directing and Implementing, (c) Evalu- 
ating, and (<0 Training. The Planning and Organ- 
izing duty covers tasks related to personnel, sup- 
ply, equipment, budget, and workload control. 
This duty is designed to assess the kinds of admin- 
istrative tasks performed by senior noncommis- 
sioned officers (NCOs). The Directing and Im- 
plementing duty assesses the role of the senior 
NCO in direct supervision. Such task statements as 
“Supervise the stock records section” and “Super- 
vise the maintenance of diesel engines” are in- 
cluded. The Evaluating duty covers those super- 
visory tasks which involve evaluating reports, 
suggestions, facilities, and the work of subordi- 
nates. The Training duty assesses the supervisory 
tasks involved in conducting on-the-job and formal 
training. 

There are important variations from the normal 
format for supervisory tasks. For example, if 
several career ladders are being surveyed with a 
single inventory, all supervisory tasks for each 
career ladder might best be listed within a single 
duty. In the Data Systems Job Inventory (AFSC 
68XXX), which surveyed five career ladders, there 
were five supervisory duties, each covering one 
career ladder. Occasionally a career ladder^ is 
encountered in v/hich there are few supervisory 
tasks. For example, in the Weather Career Ladder 
(AFSC 2S3XO), personnel at the apprentice, tech- 
nician, and superintendent levels perform over- 
lapping functions. The apprentice is basically a 
weather forecaster, as are the technician and super- 
intendent. In the Weather Job Inventory, there- 
fore, a single supervisory duty, “Supervising 
Weather Operations,” was constructed which listed 
all supervisory tasks. 

Non-supervisoiy Duties 

There are three basic formats for arranging 
non-supervisory tasks. These are the work section, 
the function, and the equipment formats. Combi- 
nations of the three can be effectively utilized; 
occasionally, a pure format can be used. When ar- 
ranging the duty format, the inventory constructor 
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decides whether function, section, or equipment 
constellations are prominent in the career ladders 
under analysis. He should remain flexible, how- 
ever, and be able to intermingle several approaches 
in one inventory if necessary. Brief descriptions of 
the three inventory formats follow. 

1. Work Section Format Incumbents in some 
career ladders serve functions in which workloads 
are deflned by organizational chart. The job inven- 
tory format for these career ladders can incor- 
porate duty headings which are equivalent to the 
work sections of the organizational chart. For 
example. Base Accounting and Finance Offices are 
typically divided into sections for Travel, Civilian 
Pay, Military Pay, Accounts Control, Commercial 
Services and Material, Paying and Collecting, Stock 
Funds, and Non-appropriated Funds. For the most 
part, job types are parallel to these work sections. 
In the Accounting and Finance Job Inventory, the 
duty titles included “Processing Military Pay,” 
“Maintaining Accounts Control,” and “Paying and 
Collecting.” In completing the inventory, an in- 
cumbent who worked in the Military Pay section 
probably spent a maximum amount of time on the 
duty “I^ocessing Military Pay” and a minimum on 
the other duties. 

The work section format usually includes a 
general duty listing tasks which are the same no 
matter where they are performed. The purpose of 
the general duty is to eliminate the duplication of 
task statements between duties. For example, in 
the Jet Engine Mechanic Career Ladder, the task 
“Cover engine openings” is performed both at the 
flight line and in the engine repair shop. Therefore, 
the task was listed in the job inventory under the 
general duty “Maintaining Jet Engines,” rather 
than under flight line or repair shop duties. 

2. Function Format. The function format may 
be used in two ways. First, it nuy be used in a job 
inventory for a career ladder which has the respon- 
sibility of maintaining one large class of equip- 
ment. The duty headings in this case begin with 
typical maintenance verbs or functions. For 
example, the Helicc^ter Medunic (AFSC 431X0) 
is responsible for the entire aircraft. He inspects, 
troubleshoots, -adyusts, repairs, and performs pre- 
ventive maintenance on helicopter components 
and systems. Therefore, in the job inventory for 
this career ladder, duty titles sudi as “Inspecting 
Helicopter Components,” “Servicing Helicopters,” 
and “Removing and. Replacing Helicopter Com- 
ponents” were used; 

The secoiid way in udiidi a function format 
may be used is much more general. It may be 
ap^ied to . career ladders in vdiidi the work con- 
sists of performing diverse functions on differing 



classes of equipment, personnel, or other subject 
matter. In these cases, the inventory constructor 
must search for ways to divide the work into 
broad functions in which the tasks are cohesive 
because of some common denominator. In such 
career ladders as Preventive Medicine (AFSC 
907X0), Dental Laboratory Specialist (AFSC 
982X0), or Weather (AFSC 2S3X0), the work is 
not deflned by organizational chart, does not in- 
volve a single class of equipment, and cannot be 
described with a limited number of typical verbs 
such as “troubleshoot” or “inspect.” The Pre- 
ventive Medicine Specialist, for example, performs 
military public health functions, epidemiological 
functions, and bio-environmental engineering 
functions. Each of these activities or functions is 
relatively independent, since there is little transfer 
of training from one function to another. Once 
these functions were isolated during inventory 
construction, duty headings such as “Performing 
Bio-environmental Engineering” or “Performing 
Military Public Health Functions” were developed. 

3. Equipment Format. In career ladders in 
which members are responsible for the mainte- 
nance of different types of equipment, an 
equipment-oriented format is useful. For example. 
Electrical Power Production Specialists (AFSC 
S43X0) maintain air compressors, centrifuges, 
cooling systems, diesel engines, exciters, gasoline 
engines, generators, intake and exhaust systems, 
and switchgear. The best single format for the job 
inventory in this instance is one in which the duty 
titles are associated with each equipment group. In 
the inventory, therefore, typical duty titles were 
“Maintaining Diesel Engine,” “Maintaining Gener- 
ators,” and “Maintaining Intake and Exhaust 
Systems.” 



III. INTERVIEWING TECHNICAL ADVISERS 
FOR JOB INFORMATION 

y 

Construction and Review of Job Inventories 

The construction of a job inventory involves 
three phases. First, the inventory constructor con- 
sults training and technical publications which 
describe the work content of the career ladder 
under analysis. From these publications he ab- 
stracts task statements and arranges them under 
duty headings. Next, in interviews with teclmical 
ad^is (i.e., members working in the career 
ladder), the inventory constructor solicits recom- 
mendations for additions, changes, or deletions to 
the list. FiruUy, a preliminary version of the inven- 
tory is printed and mailed to technical advisers in 
the fleld vriio are asked to add written comments. 



Initution of Interviews 

In general, interviewing begins when the con- 
structor’s rea^ng of publications about work con- 
tent has reached a point of diminishing returns. 
Although criteria for the decision to begin inter- 
viewing are sutjective, there may be several indi- 
cations to the constructor that interviewing would 
be more productive than further reading. 

1 . In the normal situation, the constructor will 
need elaboration of detail from interviewees after 
he has developed a preliminary inventory con- 
sisting of 150 to 200 tasks. 

2. Occasionally, the constructor inay continue 
reading puMicatioiu to uncover additional tasks. If 
he finds that there are fewer and fewer task state- 
ments per page, however, it is possible that the 
source materials are too specific. In this case, the 
coiutructor's time is best spent in interviewing. 

3. In some career ladders, .the subject matter 
may be so complex that it is incompr^ensible to 
the constructor. In sudi cases, discussion with 
technical advisea is probably mote fruitful for the 
cciutructor than his independent reading. For 
example, in reading Career Development Course 
volumes for the Electronic Computer Repairman 
Career Ladder (AFSC 30SX3), the iiwentory con- 
st ructor encountered a ^apter on B^ean 
Algebra. The time of the constructor was best 
spent in asking technical advisers what tasks in- 
volved the use of Boolean Algebra, rather than in 
learning Boolean Algebra and deducing its use. 

4. An inventory constructor might wish to see 
the work being performed so that he can better 
understand the publicatioiu he has read. If the 
constructor is able to arrange toun of work activ- 
ities, he will usually heighten his interest in and 
undmtanding of the career ladder. 

Sclectioa of Interviewees 

Since the final version of the job inventory is 
used to survey work performed in virious com- 
mands, including work performed at overseas and 
continental United States duty sites, the best pos- 
sible interviewee is a senior NCO who has served in 
all conunands both stateside and overseu. Since 
such a person is a rarity, the usual strategy is to 
select several senior NCOs, each of whom has had 
experience in several vrotk situations. The most 
important selection factor is the particular work 
experience. In nuintenance career ladders, for 
exampls, incumbents tend to specialise on certain 
kinds of equipmect. There are Electronic Com- 
puter Repairmen who have never worked on dis- 



play equipment, even though disfday equipment is 
in the job training standard for that career ladder. 
There are Aircraft Inertial and Radar Navigation 
Systems Repairmen who have never worked on 
forward-lool^g or side-looking radar, even though 
these equipments are in the job training standard 
for that career ladder. The first rule, then, is to 
make sure that at many different kinds of work 
experience as necessary are being tapped. 

Apprentice level airmen are sometimes better 
able to provide useful information about specific 
jobs than are supervising personnel who are not 
engaged in the activities at the working level. In 
such cases, the constructor probably will be 
referred to the lower level airman. For example, 
when interviewing in the Accounting and Finance 
Career Ladder (AFSC 67XXX), the constructor 
was referred to an apprentice level airman who 
worked in the Miliury Pky Computer Unit. The 
tasks there were familiar to the apprentice since he 
performed them on a daily basis. 

It is helpful to interview officers or civilians at 
appropriate levels when knowledge of administra- 
tive matters is required. For example, officers who 
worked in Base Accounting and FirarKe Offices 
were hdpful because of their overall knowledge of 
document flow from one section to another. Al- 
though a senior NCO was in charge of the Travel 
Section, one of the officers vras in a position to 
observe the interrelation of the Travel and other 
Accounting and Finance sections. In general, 
officers can be helpful in setting up appointments 
with enlisted men, since the officers are in a 
position to know the background and current re- 
qionsibilities of the men. 

Instructors at technical schools are generally re- 
garded as the best single group of advisen. As a 
rule, these advisers are technically competent, ate 
capable of communicating with othen about the 
work, and ate knowledgeable of both usual and 
unusual work situations in their career ladders. 
Further, interviews conducted at technical schools 
tend to be especially productive since individuals 
with different backgrounds are often congrepted 
there. 

The scope of the tedinical adviser's job fre- 
quently depends upon the size of his organization 
or installation. For exatiqde, if he is with a large 
organization, it is poaaible that his job is more 
specialized than it would be at a small organiza- 
tion. If technical advice is solicited from members 
of a large organization, it is important to obtain 
several interviews to ensure a complete picture of 
the tasks, in the career l^der. In contrast, if the 
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organization is small and is serving a small instal- 
lation, but has the same function as a large organ- 
ization at a large base, the interviewing require- 
ments are different. Incumbents at the small or- 
ganization are likely to be familiar with the entire 
function of the organization; therefore, fewer 
interviews are needed. 

Not only does the function of the organization 
differ at small and large iiutallations, but the 
method of performing the function may also be 
different. Further, a particular function may be 
assigned to a career ladder even though it is only 
performed at one or two bases. An example of 
one of these variations is the Medical Materiel 
Specialist serving a small 10-bed dispensary who 
uses manual item-accounting procedures, con- 
trasted with the Specialist serving a SOO-bed 
hospital who uses mechanized item-accounting 
procedures-a completely different system. As 
another exanq>Ie of duty variation within a career 
ladder, there are only a few individuals in the Pre- 
ventive Medicine Career Ladder who monitor the 
handling of dangerous missile fuel mixtures. The 
inventory, of course, must account for the tasks 
performed by the few as well as those performed 
by tite many. 

Substance of the Interview 

The job survey interview is a fact-finding de- 
vice, similar in many aspects to the market re- 
search interview. Since the interview is not per- 
ceived in the light of a personnel evaluation or a 
typical supervisor-subordinate relationship, there is 
little likelihood that it will be threatening to the 
interviewee. Rapport is important, of course, but 
the primary objective of the interviewer is to stim- 
ulate the memory of the interviewee. The inter- 
viewer must make sure that the adviser does not 
perceive the interview as an investigative or evalu- 
ative one; he must inform the interviewee that he 
is interested in job infomution only. Most advisers 
are eager to participate in the interview. They are 
told that they are contributing to an Air Force 
survey of their career ladders and that letters of 
appreciation for their contributions will be sent to 
their commanding oflkets. 

In the interview, each adviser is presented with 
a list of tasks arranged under duty headings for his 
career ladder. He is asked to reword, delete, or 
make additions to the tasks. The chief advantage 
of this checklist method is that it stimulates recall. 
In the preliminary task list, the ominion of a 
whole duty or work area probably is more detri- 
mental to the inventory than the omission of some 



tasks under a duty for which other tasks have 
already been listed. In cases in which significant 
tasks are omitted from a defined duty, the tasks 
can be quickly added by the advisers. On the other 
hand, advisers are less likely to recall a major duly 
or work area wiiich has been omitted, since there 
is no memory stimulus for it. Therefore, the dis- 
covery and documentation of broad work areas is 
initially more important than the elaboration of 
individual tasks within a broad work area. For 
example, a Preventive Medicine Specialist was 
shown a list of organisms which members of his 
career ladder must be able to collect and identify. 
Because of the frame of reference provided in the 
duty category “Collecting and Identifying Organ- 
isrm,” he was quickly able to recall two organisms 
which had been omitted from the list. 

It has been shown that an interviewer can also 
promote the adviser's recall by a particular 
questioning technique (Morsh & Archer, 1967). 
For example, the interviewer might ask any one of 
several probing questioru; 

Ii thii the only way the taA can be performed? Ir 
there another way? 

What if the difference between thii task and tadc 
E-12 on the previoui page? 

Will this taA as stated also cover the same function 
as performed at command level? 

Is it better for these taAs to refer to components 
in general, or should they refer to components of 
specific equipment? 

Is titis taA at the same level of specificity as the 
other tadis? Should it be broken down into smaller 
Usks? 

Such questions are not leading; they do not 
obscure information or inteiject interviewer bias. 
They merely ask the adviser to expand on what he 
has already told the interviewer. Their chief pur- 
pose is memory stimulation. An adviser can often 
bring up new associations and offer new infor- 
mation or new ways of orgaiiizing the material 
through such stimulation. 

It is important that semantic problems be 
clarified during interviews. The interviewer must 
look for indications that a particular task state- 
ment may have different meanings for different 
incumbents. He must be alert to task statements 
which are worded ambiguously. For example, the 
statement “Monitor workloads of shop personnel” 
may be interpreted to mean “Make work assign- 
ments," “Prepare manning documents,” or “Edit 
time cards of shop personnel.” The method by 
which a task is performed is a crucial variable, 
particularly in cases where the incumbent is not 





likely to be acquainted with all methods of per- 
forming a given task. For example, a lineman on a 
telephone cable installation crew pointed out in 
interview that the task **Dig cable trenches” could 
be accomplished either with hand tools or with 
trenching machinery. Since all incumbents would 
not have access to trenching iiuchinery, it was 
necessary to make this distinction in the task state- 
ment. In contrast, the methods of performing 
some tasks are to variable that a genend format it 
more appropriate. For example, the statement 
“Coordinate with supply activity to solve supply 
problems” is a more economical coiutruction than 
a series of statements depicting each type of prob- 
lem and each method uud to solve the problem. 

Types of Interviewees 

Since tome technical advisers are better inter- 
viewees than others, the coiutructor learns to 
spend a minimum of time with noncommunicative 
advisers and a maximum with more hdpful ad- 
visers. For practical purposes, technical advisen 
can be described on the basis of their interview 
behavior as good, average, and poor interviewees. 

1. Good Ifiterviewtcs. The most important 
characteristic of a good interviewee it that he it 
concerned with personnel and management prob- 
lems in his career ladder. He is aware tfiat the in- 
ventory is an instrument designed to analyze the 
task structure of his Air Force oociqwtion. He it 
highly motivated and feds a sense of personal in- 
volvement in the study. Aldiough he givet infor- 
mation about his present assignment, his thinking 
encompasses Air Force-wide situatkms. If either 
the content of the task statements or the duty 
structure of the inventory is amiM, he is capable of 
mentally reorganizing die inventory format. Good 
interviewees tend to be characterized by one of 
two behavior patterns. The first type of individual 
tends to be rather mature, solid, anid authoritative, 
identifying stronify with his career ladder. He may 
even have a kind of paternalistic attitude about his 
career ladder, feeling that he is in a position to 
guide and develop younger menibers. He is capable 
of being critical without being destructive. The 
second type of individual tends to be meticulously 
attentive to detail, attempting to show* or tdl the 
interviewer everything ttat he knows about this 
career ladder. He is qpite talkative and produces an 
abundance ofjobinformation. Both ty^ of inter- 
viewees are wiling to spend as much thae as 
necessary with the interviewer to ensure that the 
subject is completely coveted. 



2. Average Interviewees. An average 
interviewee it capable of reviewing and adding to 
the inventory, but his coverage does not tend to be 
exhaustive. Perhaps because of a lack of experi- 
ence or a lack of curiosity, his Air Force orient- 
ation is somewhat circumscribed. Hit tends to 
regard the inventory at just one more set of paper- 
work to be reviewed. He may be a dockwatcher, 
willing apparently to give oidy a limited amount of 
time to the interview. He needs to be questioned 
often to stimulate hit memory. 

3. Poor Interviewees. Poor intervie'vees tend to 
be characterized by one of several kinds of be- 
havior. The fint pattern suggests an individual who 
it essentially unmotivated to partidpate in the 
study; possibly he it doing to only because ordered 
to by a supervisor. The second pattern suggests an 
individual who it somewhat antagonistic to the 
interviewer; he conveys the impression that the 
interview it a watte of time and that he would like 
to terminate it as soon at possible. The third 
pattern suggests a person who accepts the form 
and content of the inventory rather pastivdy with- 
out adding significant contributiom. Firudly, there 
is an iridividual who seerm to be extremdy critical 
of the entire project. He usuaOy maintaim that his 
work it too Comdex to detcrite and generally dis- 
regards the value of any job inventory or the 
validity of any job description derived from an 
inventory. 

The words “good,” “average,” and “poor” at 
used are intended to describe types of interview 
behavion only and have no reference to the 
general adequacy of incumbents on the job. The 
interviewer can usually perceive early in the 
session whether the interviewee it good, average, 
or poor. It is somet i me s difficult, however, to dis- 
criminate the authoritative “good” interviewee 
from the hypercritical “poor” interviewee, 
especially if the career ladder beiitg surveyed re- 
quires a technical knowledge foreign to the con- 
structor’s own experience. In such cates, it may be 
difficult for the interviewer to ditoem whether 
critidsms offered are the constructive ones of an 
authoritative “good” int e rvi e w ee or the noncom- 
rmuiicative ones of a hypercritical “poor” inter- 
viewee. 

Types of IntciviewB 

Studies have diovm fiiat iruividual interviews 
are most effective during early stages; group inter- 
views are valuable near the end of the interviewing 
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proem (Archer & Fnichter, 1963). In an individ* 
iial interview, the interviewee teerm to be under 
no group preuure to conform, and he tends to 
produce information without fear of contra* 
diction. Alio, he receives all of the interviewer’s 
attention. On the other hand, poup interviews are 
most helplul after the buic inventory has been 
constructed and some agreement on semantics is 
needed. 



IV. JOI INVENTORY SAMPLE IIAS 

The sample of airmen surveyed in a job inven* 
tory administration is usually quite large. A sample 
rarely includes less than 20 percent of the popu* 
lation of a given career ladder. A more usual figure 
is 40 to SO percent; for many career ladden, 100 
percent sampling is attempt^. Samples in recent 
studies have averaged from 1,150 to 1,250 subjects 
(Mayo, 1968). Snoe the use of large samples, 
ensures adequate coverage of work performed in 
any career ladder, why, then, shotdd samples be 
studied for possible bim? The answer is that there 
are facton affecting sample composition which are 
beyond the control of inventory sample designers. 

First of all, itKumlbents may be difficult to 
trace because of reasaipiment actions or tern* 
porary duty assignments. Secondly, there is the 
possibility of discrepancy between manning docu* 
riKnts in the office whidi originates job inven- 
tories and those in the field. The status of Air 
Force manpower is constantly dunging and can- 
not be expected to remain stable for research pur- 
poses. AIm, inventories are administered only to 
those incurnbents who have remained on the same 
duty assignment for at least six weeks. The 
nurnber with at least six weeks' residency in the 
same assignment tmy fluctuate from month to 
month. 

Since large samples ate typically the case, how- 
ever, none of the foregoing variables should signifi- 
cantly biu a given survey. Convetady, information 
regarding trends in under- or ove rre pre s entation of 
given strata in several samples should be valuable 
to sample designers. For example, if a trend aiuly* 
sis revved that airmen with overseas assignments 
were consistently underrepresented, efforts could 
be made to increase their repiesenution. Results 
showing such a trend would at the very least 
justify a study designed to discover the cause of 
such underrepresenUtion. 

In the present stu^, trends of under- and over- 
represenUtkMi for sdected variables were arulyzed 



across ten job inventory samples. The following 
variables were studied: 

VaiMblea 

Rank 

1 Airman Basic 

2 Airman 

3 Airman First Class 

4 Sergeant 

5 SUffSergeant 

6 Technical Sergeant 

7 Master Sergeant 

6 Senior Master Sergeant 

9 Chief Master Sergeant 

Location 

1 Continental United States 

2 Overseas (Induding Alaska and Hawaii) 

Sex 

1 Female 

2 Male 

Mi^r Command 

1 Alaskan Air Comnumd 

2 Air Defense Command 

3 Air Force Accounting and Finance Center 

4 Air Force Communications Service 

5 Air Force Logistics Command 
€ Air Force Systems Command 

7 Air Training Command 

8 Air Uiiiveisity 

9 Continental Air Comnund 

10 Headquarten Command 

11 Headquarten, United States Air Force 

12 . Milita^ Airlift Command 

13 Rwific Air Fbrce 

14 Strategic Air Command 

15 Tactical Air Command 

16 United Sutes Air Force Academy 

17 United Sutes Air Forces in Europe 

18 United Sutes Air Forces Southern Command 

Months of Active Federal Military Service 

1 1 to 12nMnths 

2 13 to 24 months 

3 25 to 48 months 

4 49 to 96 months 

5 97 to 144 riMnths 

6 More than 144 months 

Enlist nwnt 

1 Fint 

2 Other than fint 

The chi-square one-sample test for goodneu-of* 
fit was used to test for samfrie bias. If the observed 
frequency of a variaUe was significantly different 
from the expected frequency at the .01 prob- 



ability level, that variable was declared mUrepre- 
sentative. Three types of fit were documented: 
representative, underrepresentative, and overrepre- 
sentative. In this discuttion, misrepresentations of 
variables are considered to be biased. The term 
“biased” is used in a statistical sense only, how- 
ever; the samples were much too large to be mean- 
ingfully biased. For example, if the observed fre- 
quency for a variable was 250 and the expected 
frequency was 300, the chi-square test would be 
significant at the .01 level. However, 250 subjects 
would be entirely adequate for any nriable in 
question. Again, the purpose of the study was to 
discern whether tren^ of misrepresentation 
existed for any of the variables selected. 

Students at various Air Force technical training 
centers were considered as population members in 
all career ladders surveyed; however, students were 
not typically included in samples. Therefore, mis- 
representations were expected for those variables 
which would be affected by the lack of students in 
the sarrqdes. More specifically, biases of underrep- 
resentation were expected for airmen in the ranks 
of Airman and Airman First Clan, for members 
with I to 1 2 of months active federal militaiy serv- 
ice, and for members assigned to Air Training 
Command. Job inventory samples for the follow- 
ing career ladders were studied: 



significant at the .01 level, with an expected value 
larger than the observed value. Results for each of 
the valuable categories are discussed separately in 
the following paragraphs. 

1. Sex. Tire 20XXD, 67XXX, 68XX0, 903X0, 
and 906X0 career ladders were the only ones in 
the study compoaed of members of both sexes. 
Results showed that each of the five samples was 
representative of the population with respect to 
the variable Sex. 

2. Rank. The results for the variaMe Rank are 
included in Table I. It it apparent that a large 
majority of the levels of rank were representative. 
Hoivever, the rank Airman underrepresented 
in each samide except for 906X0. The rank Air- 
man Fint Clan was underrepresented in the 
301X4, 46XXD, and 906X0 samples and overrep- 
resented in the <S7XXX sample. The rank Sergeant 
was overre p resented in all sartqiles except for 
906X0 and 67XXX; the latter rar^ was represent- 
ative for 906X0 and underrepresentative for 
67XXX. All other leveb of rank were represent- 
ative for an ten career areas. 

3. Location. AD sarrqiles were representative 
for the variable Location except for 543X0 and 
903X0, in which airmen stationed in the conti- 
nental Ihiited States were overr ep resented. 
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RcNks 

The results of fire analyses for the variables 
Rank, Command, and Monttrs of Active Federal 
MilitBty Service are shown in Table 1. bthetaMe, 
an “r” (r ■ representative) signifies that the chi- 
squue test for die variaUe- was not significant; an 
(o ■ ova ri epiese ntati ve) means that the test 
was sig n i fi ca n t at the J)1 lend, widi an observed 
value larier than the cnpectad value; anda “u” (u 
■ underreprescaladve) signifies that the test was 



4. Commend. Results for the variable Com- 
mand ate included in Table 1. The commands 
AFAFC, AFCS, AFLC, CONAC, HQ COMD, HQ 
USAF, MAC, and USAPA were m is r e pres en t^ in 
no more dian 20 percent of the sun|de. AU and 
SAC were ov er r ep reeer t ted in 20 percent of the 
samples and underwpreeentad in 10 percent. AAC, 
ADC, AFSC, TAC, and USAFSO were overrepre- 
sented in from 30 to 60 percent of the sanies 
and minimaDy und cn epieae nte d. USAFE was 
undenepresented in 20 percent and overrepre- 
sented in 20 percent. ATC was undetrepraeented 

in 70 percent and PACAF in 40 percent. 

• 

5. Mondu of Aethe Federal MOtUey Sendee. 
Results for the variable Months of Active Federal 
Mlitary Service are also included in Tkbk 1. Air- 
men with 1 to 12 months of ascvice were under-, 
r epr eeented in al ssmpiss moept for 903X0 and* 
906XD, in whidi they ware r s p ieas n t aU v e . Airmen 
with 13 to 24 monte of sstvioe were overrepre- 
sented in all aamplee oxoept for 20XXD,46XXD, 
and 906X0, in which they were n n deneprese nt ed, 
and 903X0, in which they were representative. 
Airmen with 25 to 48 months s ervic e were over- 
represented in al aaraples except for S43XO, 
67XXX, 903X0, and 906X0, b which they were 
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representative. Airmen with 49 to 96 months serv- 
ice were overrepresented in the S43X0 sunple; air- 
men with 144 or more months service were under- 
represented in the 301X4 sample. All other vari- 
able levds were representative in each sample. 



6. Enlistment. The results for the variable En- 
listment showed that all samples were represent- 
ative except for the 20XX0, 46XX0, 46XX0, and 
S43X0 samples, in which airmen serving on their 
first enlistment were underrepresented. 



ruble 1. Repitaentathencn of Survey Samples for Rank, Command, 
and Months of Active Federal Mlhaiy Service 
(Rep n smt e t iv en ms : r « teprmmtetim; m “ u nde rr ^ i m m t m tii» : o « ovtm p n s e n lativs) 
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Discuarion 

Overrepresented variables are not as much of a 
problem as underrepresented ones since lack of 
representation means loss of potential data while 
overrepresentation signifies an abundance of data. 
With respect to the variaMes Location and Months 
of Active Federal Military Service, it was fortunate 
that the rank Sergeant and the months of service 
13 to 24 months and 25 to 48 months were the 
variable leveb overr^resented. Airmen from these 
variable levels usually are at the worker or journey* 
man skill level, which is the most inqrartant skill 
level to be studied in a job analysis. 

The underrepresented variable levels were 
generally those which could be predicted from the 
knowledge that student members were not in- 
cluded in the samples, with the sin^e exception of 
the relatively high number of underrepresentations 
for the command variable PACAF. Poor return 
from members of PACAF may be attributable to 
the increasing complexity of administrative actions 
(including testing) in the Pkcifk and Far East. 

The samples were largely representative with re- 
spect to sex, location, and enlistment. 



V. SUMMARY AND CONCLUSIONS 

Three aqwcts of job inventory construction and 
administration were studied in depth.These were 
the categorizing of task statements by duties, the 
interviewing of technical advisers for job infor- 
mation, and the composition of inventory samples. 
The conclusioiu may be summarized as follows: 

1. Duty Categories. VaiiatkMu in the usual 
four-duty format for supervisory tasks are occa- 
sionally necessary. Thiw rather stable organ- 
izations for non-supervisory tasks are the work 
section, function, and equipment formats. In the 
work section format, tasks are arranged in groups 
paralld to the work sections of orguiizationa! 
charts. Tasks are grouped under typical functioru 
charged to a career ladder in the fiuiction format. 
Tasks are arranged under equipnwnt categories in 
the equipment format. 

2. Interviewir^. The value of interviews to 
derive job information can be enhanced by coruid- 
eration of several facton. First, the point at whidi 



interviewing becomes more productive than publi- 
cations research should be recognized. Second, 
interviewing is more productive vvhen advisers are 
chosen on the basis of experience, present job 
type, rank, and size and type of installation of 
assignment. A variety of stimuli, including ques- 
tioning the form or content of task statements, 
can be used to elicit recall. A nuucimum of time 
can be spent with better interviewees; a minimum 
with poorer ones. Individual interviews can be 
more effectively used during the early phases; 
group interviews are valuable later. 

3. Sarr^Ung. Perfect correspondence between 
samide and population strata is not necessary 
because sam^e sizes are typically quite large. 
Andyses of trends of over- and underrepre- 
sentation of various sample characteristics can be 
used to ensure that survey umpies are represent- 
ative, however. An anal 3 rsis of trends in ten inven- 
tory samples showed few unexplainable underrep- 
resentations. 
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